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1.  Project  Goals 


Engineering  research  over  the  last  few  years  has  successfully  demonstrated  the  potential 
of  thrust  vector  control  using  counterflow  at  conditions  up  to  Mach  2.  Flow 
configurations  that  include  the  pitch  vectoring  of  rectangular  jets  and  multi-axis  vector 
control  in  diamond  and  axisymmetric  nozzle  geometries  have  been  studied.  Although 
bistable  (on-off)  fluid-based  control  has  been  around  for  some  time,  the  present 
counterflow  thrust  vector  control  is  unique  because  proportional  and  continuous  jet 
response  can  be  achieved  in  the  absence  of  moving  parts,  while  avoiding  jet  attachment, 
which  renders  most  fluidic  approaches  unacceptable  for  aircraft  and  missile  control 
applications.  However,  before  this  study,  research  had  been  limited  to  open-loop  studies 
of  counterflow  thrust  vectoring. 

For  practical  implementation  it  was  vital  that  the  counterflow  scheme  be  used  in 
conjunction  with  feedback  control.  Hence,  the  focus  of  this  research  was  to  develop  and 
experimentally  demonstrate  a  feedback  control  design  methodology  for  counterflow 
thrust  vectoring. 

This  research  focused  on  2-D  (pitch)  thrust  vectoring  and  addresses  four  key  modeling 
issues.  The  first  issue  is  to  determine  the  measured  variable  to  be  commanded  since  the 
thrust  vector  angle  is  not  measurable  in  real  time.  The  second  related  issue  is  to  determine 
the  static  mapping  from  the  thrust  vector  angle  to  this  measured  variable.  The  third  issue 
is  to  determine  the  dynamic  relationship  between  the  measured  variable  and  the  thrust 
vector  angle.  The  fourth  issue  is  to  develop  dynamic  models  with  uncertainty 
characterizations. 

The  main  goal  was  the  design  and  implementation  of  robust  controllers  that  yield  closed- 
loop  systems  with  fast  response  times,  and  avoid  overshoot  in  order  to  aid  in  the 
avoidance  of  attachment.  Additionally,  these  controllers  should  be  simple  and  easy  to 
implement  and  the  methodology  used  to  design  them  should  be  valid  for  the  more 
difficult  case  of  3-D  thrust  vectoring,  which  leads  to  multiple-input,  multiple-output 
control  problems. 

An  additional  objective  of  this  research  was  the  development  of  a  robust  fault  detection 
and  isolation  methodology  applicable  to  aircraft  engines. 

2.  Project  Accomplishments 

Many  of  the  project  accomplishments  are  well  documented  in  several  publications  [1-8]. 
Hence,  this  section  briefly  summarizes  the  main  results  and  refers  to  the  appropriate 
publications.  Papers  corresponding  to  these  results  are  presented  in  the  two  appendices. 

2.1  Feedback  Control  for  Counterflow  Thrust  Vectoring  with  “Cold  Flow” 

This  research  considered  feedback  control  for  a  counterflow  thrust  vectoring  experiment 
located  at  the  Fluid  Mechanics  Laboratory  at  the  FAMU-FSU  College  of  Engineering 
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(see  Figure  1).  The  airflow  in  this  experiment  was  ambient  temperature,  as  opposed  to 
the  hot  flow  associated  with  implementation  on  an  actual  aircraft,  and  hence  is  termed 
“cold  flow.”  A  PID  controller  was  developed  for  the  system  and  was  sometimes 
implemented  with  a  Smith  predictor  and/or  an  anti-windup  scheme.  The  performances  of 
the  PID  controller,  the  PID  controller  with  a  Smith  predictor,  PID  controller  with  anti¬ 
windup  scheme,  and  PID  with  both  the  Smith  predictor  and  anti-windup  scheme  were 
compared  by  both  simulation  and  experimentation.  Both  simulation  and  experimental 
results  demonstrated  that  PID  controller  with  anti-windup  was  the  most  effective  control 
scheme.  The  results  were  published  in  [2,4].  Reference  [4]  is  given  in  Appendix  A. 


Figure  1.  Counterflow  Thrust  Vector  Control  Experiment  with  “Cold  Flow” 


2.2  Feedback  Control  for  Counterflow  Thrust  Vectoring  with  a  Turbine  Engine 

This  research  considered  feedback  control  for  a  counterflow  thrust  vectoring  experiment 
involving  a  jet  engine  turbine  (see  Figure  2)  located  at  the  Portuguese  Air  Force 
Academy  at  Sintra,  Portugal.  This  research  required  extensive  experimental  design  as 
illustrated  in  Figures  3  thru  6,  but  enabled  the  experimentation  to  much  more  closely 
mimic  flight  conditions.  PID  controllers  were  designed  using  robust  t\  theory  based  on 
mixed  structured  singular  value  theory  in  addition  to  several  other  more  conventional 
tuning  methods.  As  illustrated  in  Figures  7  and  8,  good  results  were  obtained  with  the 
robust  l\  controller  and  its  performance  was  very  similar  to  the  better-performing 
conventional  tuning  methods.  However,  the  greatest  advantage  of  robust  i\  control 
design  is  that,  unlike  the  conventional  PID  tuning  methods,  it  extends  to  3-D  thrust 
vectoring,  which  results  in  a  MIMO  control  design  problem.  The  results  of  this  research 
were  published  in  a  dissertation  [5]  and  will  soon  be  submitted  to  the  AIAA  Journal.,  a 
very  prestigious  aerospace  journal  that  publishes  multidisciplinary  papers. 
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Figure  5.  Vacuum  Pump  Used  to  Create  the  Counterflow 


Figure  6.  Experimental  Setup  with  Electronically  Controlled  Valves 


Tim*  [s] 


Figure  7.  CFTV  Closed  Loop  Step  Response  for  Pgap  from  0  KPa  to  -0.9  KPa 
(5v  from  4.9  deg  to  8.4  deg)  Using  Several  PID  Tuning  Methods 
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Figure  8.  CFTV  Closed  Loop  Sine  Wave  Response  for  Robust  l\ 

Tuning  Method 

2.3  Robust  Fault  Detection  and  Isolation  Using  Robust  (\  Estimation 

This  research  considered  the  application  of  robust  t\  estimation  to  robust  fault  detection 
and  isolation.  This  was  accomplished  by  developing  a  series,  or  bank,  of  robust 
estimators  (full-order  observers),  each  of  which  is  designed  such  that  the  residual  will  be 
sensitive  to  a  certain  fault  (or  faults)  while  insensitive  to  the  remaining  faults.  Robustness 
was  incorporated  by  assuring  that  the  residual  remains  insensitive  to  exogenous 
disturbances  as  well  as  modeling  uncertainty.  Mixed  structured  singular  value  and  f 
theories  were  used  to  develop  the  appropriate  threshold  logic  to  evaluate  the  outputs  of 
the  estimators  used  for  determining  the  occurrence  and  location  of  a  fault.  A  real-coded 
genetic  algorithm  was  used  to  obtain  the  estimator  gain  matrices.  This  approach  to  FDI 
was  successfully  demonstrated  using  a  linearized  model  of  a  jet  engine  and  was  also 
applied  to  a  complex,  nonlinear  benchmark  problem.  The  results  of  this  research  were 
published  in  [1,3, 7,8],  Reference  [7]  is  given  in  Appendix  B. 

Publications 
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2003. 

2.  E.  G.  Collins,  Jr.,  Y.  Zhao,  F.  Alvi,  M.  Alidu,  and  P.  J.  Strykowski,  “Feedback 
Control  for  Counterflow  Thrust  Vectoring,”  Proceedings  of  the  American  Control 
Conference,  Boston,  MA,  pp.  3654-3659,  June  2004. 

3.  T.  Curry  and  E.  G.  Collins,  Jr.,  “Robust  Fault  Detection  and  Isolation  Using  Robust  l\ 
Estimation,”  Proceedings  of  the  American  Control  Conference,  Boston,  MA,  pp. 
2451-2456,  June  2004. 
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Appendix  A:  “Design  and  Implementation  of  Feedback  Control 
for  Counterflow  Thrust  Vectoring”  [4] 


Design  and  Implementation  of 
Feedback  Control  for  Counterflow 
Thrust  Vectoring 


Yanan  Zhao*  Emmanuel  G.  Collins, Jr. j  Farrukh  Alvif  and  Delfim  Dores§ 
Department  of  Mechanical  Engineering 
Florida  A&M  University  -  Florida  State  University 
Tallahassee,  FL  32310 

Aircraft  thrust  vector  control  is  currently  implemented  using  movable  control  surfaces 
such  as  vanes  and  flaps.  Counterflow  thrust  vectoring  (CFTV)  is  a  fluidic  approach  to 
thrust  vectoring  that  has  the  potential  to  improve  on  the  conventional  approaches  by  re¬ 
ducing  weight  and  increasing  the  reaction  speed.  Open-loop  implementation  of  CFTV  has 
been  demonstrated  in  laboratory  settings.  However,  ultimately  this  technology  must  be  imple¬ 
mented  using  feedback  control.  The  primary  control  objective  is  to  achieve  fast  slew  rates  by 
compensating  for  the  transportation  delay  and  parameter  uncertainties.  The  paper  describes 
an  experimental  testbed  for  investigating  feedback  control  of  CFTV.  System  estimation  re¬ 
sults  based  on  open-loop  test  data  are  presented.  This  paper  then  develops  a  PID  control  law, 
which  is  sometimes  implemented  with  a  Smith  predictor  to  compensate  for  the  transportation 
delay  and/or  an  anti-windup  scheme  to  compensate  for  actuator  saturation.  The  control  laws 
are  experimentally  demonstrated  and  their  performance  is  compared  using  different  types  of 
reference  signals. 
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INTRODUCTION 

The  maneuverability  of  aircraft  is  traditionally  achieved  by  the  use  of  aerodynamic  control 
surfaces  such  as  ailerons,  rudders,  elevators  and  canards.  The  deflection  of  these  surfaces 
modifies  the  exterior  shape  of  the  vehicle  at  critical  points  of  its  structure,  thus  creating  a 
change  in  the  aerodynamic  forces  acting  on  the  vehicle  and  causing  it  to  maneuver.1’2 

Thrust  vector  control  (TVC)  is  a  more  recent  technology  that  increases  vehicle  maneuver¬ 
ability  by  directly  changing  the  direction  of  the  thrust  force  vector.  This  approach  has  been 
successfully  implemented  on  several  military  aircraft  and  has  resulted  in  increased  roll  rates 
and  enhanced  maneuverability  at  low  speed,  high  angle  of  attack  flight  conditions,  where 
aerodynamic  surfaces  are  very  ineffective.  TVC  can  also  reduce  the  distance  necessary  for 
take  off  and  landing  or  even  make  vertical  take  off  and  landing  possible. 

Current  implementation  of  TVC  employs  movable  control  surfaces  such  as  vanes  and/or 
flaps  arrayed  around  the  nozzle  exit  to  redirect  the  jet  exhaust.  The  mechanical  actuators  and 
linkages  used  to  change  the  thrust  vector  angle  add  weight  and  complexity  to  the  aircraft, 
which  leads  to  increased  cost  and  maintenance  requirements.  In  addition,  the  dynamic 
response  of  the  jet  is  limited  by  the  response  of  the  mechanical  actuators  used  and  the 
thrust  losses  are  not  small.1-3  A  promising  alternative  approach  is  fluidic  thrust  vectoring, 
where  secondary  air  flows  are  employed  to  redirect  the  primary  jet.  Fluidic  thrust  vectoring 
requires  few  or  no  moving  parts  in  the  primary  nozzle;  therefore  it  simplifies  the  hardware, 
and  reduces  weight  and  maintenance  needs.  In  addition,  it  has  the  fast  dynamic  response 
inherent  to  fluidic  devices.2-4 

Counterflow  thrust  vectoring  (CFTV)  was  first  proposed  by  Strykowski  and  Krothapalli.5 
It  is  a  technique  that  is  different  than  previously  proposed  fluidic  techniques.  Instead  of 
having  a  secondary  air  stream  inside  the  nozzle,  CFTV  uses  a  secondary  flow  travelling 
in  the  opposite  direction  to  that  of  the  primary  jet  outside  the  primary  nozzle.  Recent 
engineering  research  has  successfully  demonstrated  the  potential  of  thrust  vector  control 
using  counterflow  at  conditions  up  to  Mach  2. 1,4,6  However,  since  fluidic  concepts  in  general 
are  bistable  and  hysteretic  in  nature,  CFTV  has  some  limitations.  In  particular,  for  certain 
CFTV  geometries  the  primary  jet  tends  to  attach  itself  hysteretically  to  the  suction  collar 
at  certain  conditions.  When  this  occurs,  control  of  the  thrust  vectoring  angle  is  lost.  This 
attachment  is  difficult  to  overcome  without  large  changes  in  flow  conditions.3  A  jet  with  a 
design  Mach  number  2  was  used  in  this  research  because  considerable  experimental  results  are 
available  to  the  authors  at  this  Mach  number.  However,  it  should  be  noted  that  counterflow 
thrust  vectoring  has  also  been  demonstrated  at  other  Mach  numbers,  for  example,  Mach 
number  1.4  as  well  as  for  subsonic  flow.2,6 

Past  studies  of  CFTV  have  focused  exclusively  on  the  open-loop  behavior.  However,  for 
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practical  implementation  it  is  vital  that  the  counterflow  scheme  be  used  in  conjunction  with 
feedback.  Hence,  the  primary  objective  of  the  research  reported  here  is  to  design  and  imple¬ 
ment  effective  feedback  control  laws  for  CFTV.  Figure  1  illustrates  that  the  CFTV  feedback 
control  loop  constitutes  an  important  minor  loop  of  the  overall  aircraft  attitude  control.  The 
control  system  must  achieve  fast  slew  rates  by  compensating  for  the  transportation  delay 
in  the  presence  of  significant  parametric  uncertainty.  In  addition,  for  certain  CFTV  geome¬ 
tries  it  must  be  able  to  compensate  for  the  hysteresis  that  occurs  when  the  counterflow  is 
effectively  stopped  at  attachment.  Hysteresis  is  a  nonlinearity  for  which  traditional  control 
methods  are  insufficient.7  However,  CFTV  can  be  continuously  controlled  over  a  wide  range 
of  operating  conditions.  Hence,  in  this  paper  control  law  design  is  developed  assuming  hys¬ 
teresis  does  not  occur.  The  design  objective  here  is  then  to  obtain  fast  slew  rates  in  the 
presence  of  time  delay  and  parametric  uncertainty. 

PID  control  and  its  variations  (P,  PI  or  PD)  is  the  most  commonly  used  control  law  in 
process  control  applications  for  the  compensation  of  both  delayed  and  non-delayed  processes.8 
PID  controllers  often  display  robustness  to  incorrect  process  model  order  assumptions  and 
limited  process  parameter  changes.  As  the  detailed  physics  of  CFTV  system  are  not  entirely 
understood,  a  PID  controller  was  developed  based  on  a  model  estimated  using  experimental 
open-loop  data.  A  Smith  predictor  was  used  in  conjunction  with  PID  control  to  compensate 
for  the  effects  of  time  delay  while  an  anti-windup  scheme  was  used  to  compensate  for  actuator 
saturation. 

The  paper  is  organized  as  follows.  Section  2  describes  some  of  the  details  of  the  CFTV 
concept  along  with  the  experimental  testbed  developed  for  feedback  control  development. 
Section  3  presents  system  modelling  and  analysis  results.  Section  4  develops  a  PID  con¬ 
trol  law  and  shows  how  it  can  be  used  in  conjunction  with  a  Smith  predictor  and/or  an 
anti-windup  scheme  and  then  gives  some  closed-loop  simulation  results.  Section  5  presents 
experimental  results.  Finally,  Section  6  presents  some  conclusions. 

DESCRIPTION  OF  COUNTERFLOW  THRUST  VECTORING 
(CFTV)  AND  THE  EXPERIMENTAL  TESTBED 

In  this  section,  the  concept  of  CFTV  is  described  and  an  experimental  testbed  for  inves¬ 
tigating  feedback  control  of  CFTV  is  presented. 

Counterflow  Thrust  Vectoring 

The  basic  geometry  of  a  CFTV  device  used  for  pitch  vectoring  is  illustrated  in  Figure 
2.  The  collars  are  placed  on  either  side  of  the  primary  flow  nozzle  (top  and  bottom  in  the 
figure)  creating  gaps  between  the  exhaust  jet  and  the  collar  surfaces  which  are  curved  away 
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from  the  jet  axis  in  the  streamwise  direction.  To  achieve  upward  thrust  vectoring  at  an  angle 
Sv,  for  example,  a  secondary  counterflow  must  be  established  between  the  primary  jet  and 
the  upper  collar  surface,  creating  a  continuous  flow  path  between  the  surrounding  ambient 
fluid  and  the  vacuum  system.  The  action  of  counterflow  in  the  upper  shear  layer  gives 
rise  to  asymmetric  entrainment  and  a  cross-stream  pressure  gradient  sufficient  to  vector  the 
jet.4  When  the  vacuum  system  is  activated,  creating  counterflow  in  the  gap  between  the  jet 
and  the  collar,  continuous  thrust  vectoring  can  be  achieved.4  Previous  experimental  studies 
have  demonstrated  continuous  control  for  values  of  5V  up  to  20  degrees.2  In  this  figure,  G 
represents  the  gap  height  and  H  is  the  nozzle  height. 

It  is  important  to  recognize  that  the  thrust  vectoring  angle  cannot  be  directly  measured 
in  practical  implementation  of  CFTV,  although  experimental  techniques  do  allow  its  mea¬ 
surement  in  laboratory  settings.  However,  it  has  been  shown  that  the  pressure  parameter 
)  which  is  essentially  a  non-dimensional  ratio  of  the  side  force  acting  on  the  collar 
and  the  axial  force  imposed  by  the  jet,  has  a  nearly  linear  relationship  to  the  thrust  vector 
angle  over  a  wide  range  of  conditions  (see  Figure  9  of  the  reference  paper)  .4  Here,  Pq  is  the 
pressure  established  in  the  secondary  stream  as  measured  in  the  jet  exit  plane  on  the  collar 
surface,  A Pq  is  the  static  negative  gauge  pressure  in  the  jet  exit  plane  on  the  collar  surface 
(i.e.,  A PG  =  Patm  —  Pq,  where  Patm  represents  the  absolute  atmospheric  pressure),  Asi,ie  is 
the  collar  side  area,  p  is  the  primary  jet  density,  U  is  the  primary  jet  velocity,  and  Ajet  is  the 
jet  area  at  the  nozzle  exit.  Thus,  in  practice  A  Pq  will  be  selected  as  the  command  variable. 

For  certain  CFTV  geometries,  if  the  pressure  on  the  collar  wall  drops  too  much  (i.e., 
A  Pq  becomes  very  large),  the  deflection  of  the  jet  will  be  too  severe  and  it  will  attach  to 
the  wall.  If  this  happens,  continuous  control  of  the  jet  is  compromised  since  at  this  time 
thrust  vectoring  angle  would  generally  jump  to  a  value  near  the  collar  terminal  angle.  Jet 
attachment  is  a  hysteretic  phenomenon  since  once  the  jet  is  attached  to  the  collar,  changes 
in  the  secondary  flow  have  little  effect  on  the  thrust  vectoring  angle,  and  simply  reducing 
the  counterflow  rate  to  reduce  A  Pq  back  to  the  value  at  which  jet  attachment  occurred  is 
not  sufficient  to  release  the  jet  from  the  collar.3  Feedback  control  of  CFTV  in  the  presence 
of  hysteresis  in  beyond  the  scope  of  this  paper. 

Experimental  Testbed 

To  investigate  feedback  control  of  CFTV,  a  testbed  has  been  successfully  set  up  in  the 
Fluid  Mechanics  Research  Laboratory  at  the  Florida  A&M  University  -  Florida  State  Univer¬ 
sity  College  of  Engineering.  The  characteristics  of  the  current  experiment  have  been  shown 
to  match  those  in  the  literature.2,4 

The  experimental  testbed  consisted  of  five  major  parts:  ajet,  a  collar,  a  control  valve,  two 
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pumps  and  the  pipe  connections.  A  schematic  functional  diagram  of  the  testbed  is  shown  in 
Figure  3.  Notice  that  for  simplicity  only  one  collar  was  used.  Hence,  the  experiment  allows 
only  positive  pitch  angles  5V. 

The  rectangular  Mach  2  jet  in  the  exit  plane  has  a  width  of  32.5  mm  and  a  height  of  5 
mm.  The  inner  contour  of  the  collar  is  an  arc  of  constant  radius  of  curvature  swept  through 
an  angle  a  and  extending  downstream  of  the  nozzle  exit  for  a  distance  given  by  L  =  R  sin  a , 
where  L  =  34  mm,  R  =  78.5  mm  and  a  =  25.6  deg  (see  Figure  4). 

The  forward  stream  to  the  jet  is  supplied  by  a  high-displacement  reciprocating  compres¬ 
sor,  which  is  capable  of  supplying  air  at  a  maximum  storage  pressure  of  160  bars.  The 
vacuum  source  for  the  counterflow  is  provided  by  two  Fuji  VFC804A-7W  pumps  mounted 
downstream  of  the  test  rig.  The  two  pumps  can  be  connected  in  series  as  shown  in  Figure 
3,  or  they  can  be  used  separately,  i.e.,  either  of  the  pumps  can  be  disconnected  from  the 
testbed. 

To  implement  feedback  control,  a  control  valve  is  installed  between  the  collar  and  pumps 
to  control  the  counterflow,  which  determines  the  thrust  vector  angle.  A  model  27N  pneumatic 
R-DDV  servovalve  from  HR  Textron  is  used  in  the  test  rig  for  this  purpose. 

Data  acquisition  and  control  are  implemented  using  dSPACE,  which  consists  of  a  DS2002 
A/D  board,  a  DS2102  D/A  board,  a  DS1005  PPC  board,  and  a  PX10  expansion  box.  To 
monitor  the  jet  pressure  (which  should  be  115  psi  for  a  Mach  2  jet),  a  Validyne  multiple 
range  pressure  transducer  (model  DP15TL)  is  used.  There  are  11  static  pressure  taps  along 
the  collar  wall,  and  the  multiple  pressure  measurements  required  to  determine  the  collar 
static  pressure  distribution  are  facilitated  by  a  Scanivalve  model  OED2  pressure  sampling 
scanner. 


SYSTEM  MODELLING  AND  ANALYSIS 

Although  the  general  principles  responsible  for  CTFV,  i.e.,  increased  entrainment  due 
to  counterflow  are  known  (see  reference1,4  for  details),  the  detailed  physics  of  CFTV  are 
not  entirely  understood;  thus  it  is  difficult  to  build  a  CFTV  model  using  first  principles.  In 
this  section,  system  modelling  and  parameter  estimation  were  performed  based  on  open-loop 
tests. 

Open-loop  tests  and  system  modelling 

The  model  required  for  feedback  control  design  has  the  voltage  to  the  control  valve  as  the 
input  and  the  command  variable  A Pq  as  the  output.  To  study  the  system  characteristics 
under  different  operating  regions,  the  CFTV  testbed  has  been  extensively  tested  for  step 
inputs  with  amplitude  1  volt,  2  volts,  ■  •  5  volts.  (The  range  of  the  control  valve  voltage 
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is  [0,  5]  volts.)  To  capture  the  transient  performance  of  the  system  clearly,  the  step  signals 
were  applied  at  t  =  10  sec.  One  set  of  resulting  step  responses  is  shown  in  Figure  5. 

The  tests  were  performed  with  both  the  first  and  second  vacuum  pumps  on  and  a  ge¬ 
ometry  ratio  of  G/H  =  0.38.  The  sampling  rate  was  chosen  as  Ts  =  0.01  sec.  Due  to  the 
installation  of  collar  at  the  exit  of  jet  engine,  thrust  vectoring  exists  with  even  a  fully  closed 
control  valve.  To  consider  only  the  effect  of  the  control  valve,  open-loop  response  curves  rep¬ 
resenting  —(Pc(t  >  lOsec)  —  Pc(t  =10sec))  were  plotted  as  shown  in  Figure  6.  A  negative 
sign  is  used  since  a  higher  control  valve  signal  always  results  in  lower  gap  pressure  along  the 
collar. 

By  observing  the  open-loop  step  responses  of  the  system,  second  order  models  were 
constructed  to  represent  the  system  dynamics.  The  second  order  models  with  time  delay  are 
of  the  form,  T2s2^T^s+1e~u,  where  K  is  the  gain,  T  is  the  time  constant,  £  is  the  damping 
ratio,  and  L  is  the  time  delay  of  the  system.  Experimental  open-loop  methods  for  parameter 
estimation  have  been  widely  studied.9  A  method  proposed  by  Huang  and  Chou,10  a  five-point 
method,  was  used  to  estimate  the  process  parameters.  The  estimated  parameters  under  five 
different  control  valve  voltage  inputs  are  listed  in  Table  1. 

Figure  7  compares  the  simulated  step  responses  based  on  the  estimated  models  and  the 
test  data  under  different  control  valve  voltages.  It  is  seen  that  a  second  order  plus  time  delay 
model  closely  matches  the  time  delay  and  the  steady  state.  However,  the  estimated  model 
has  a  slightly  faster  rise  time  than  the  test  data  since  the  dashed  lines  in  Figure  7  arrive  at 
their  steady-state  values  slightly  faster  than  the  solid  lines. 

As  shown  in  Table  1,  under  different  control  valve  inputs,  the  parameters  of  the  second 
order  models  had  different  values.  The  gain  K  varied  within  13.06%  of  its  average  value, 
the  time  constant  T  varied  within  15.84%  of  its  average  value,  the  damping  ratio  £  varied 
within  5.93%  of  its  average  value,  and  the  time  delay  L  varied  within  2.82%  of  its  average 
value.  The  parametric  variations  at  different  operating  points  are  assumed  to  be  due  to 
nonlinearities  in  the  control  valve  and  fluid  dynamics. 

Additional  Sources  of  Uncertainty  in  the  CFTV  System 

The  CFTV  system  suffers  from  additional  sources  of  uncertainty.  Two  of  the  major 
sources  are  described  below. 

The  dynamics  of  CFTV  changes  along  with  the  power  level  of  the  pumps.  For  example, 
the  running  temperature  of  the  pumps  affects  their  efficiency,  and  thereafter  the  CFTV 
dynamics.  A  colder  pump  is  more  efficient  and  hence  produces  higher  counterflow.  Usually, 
the  gap  pressure  obtained  with  a  colder  pump  is  lower  than  that  of  a  warmer  pump.  An 
inter-cooling  system  is  desired  to  keep  the  pump  running  at  peak  efficiency;  however,  it  is 
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not  used  in  the  current  experiment. 

The  dynamics  of  CFTV  also  changes  along  with  ambient  conditions.  For  example,  the 
temperature  of  the  air  supplied  to  the  jet  affects  the  performance  of  CFTV  system.  The 
air  source  of  the  compressor  is  the  atmosphere  air.  Due  to  the  variation  of  atmospheric 
temperature,  the  temperature  of  the  air  supplied  to  the  jet  engine  is  not  guaranteed.  The 
temperature  change  causes  the  performance  variation  of  the  primary  flow,  and  thereafter  the 
collar  pressure. 

Another  set  of  open-loop  tests  was  performed  to  illustrate  the  above  uncertainty.  It  was 
also  conducted  with  both  the  first  and  second  vacuum  pumps  on  and  a  geometry  ratio  of 
G/H=0.38  as  was  the  case  corresponding  to  the  tests  of  Table  1.  However,  though  not 
explicitly  recorded,  the  ambient  temperature  for  this  set  was  different.  (This  test  set  was 
conducted  on  the  afternoon  of  April  14,  2004,  while  the  test  set  corresponding  to  Table  1 
was  conducted  on  the  morning  of  March  3,  2004.)  In  addition,  the  power  level  of  the  pumps 
varied  for  the  two  experiments.  The  gains  obtained  with  the  second  experiment  are  shown 
in  Table  2.  It  is  seen  that  these  values  are  significantly  different  from  those  shown  in  Table 
1. 


PID  Controller  Design 

After  the  CFTV  system  model  was  obtained,  feedback  control  laws  were  designed  to 
control  APg  and  thus  the  counterflow  thrust  vector  angle  Sv.  To  increase  the  ability  to 
maneuver  the  vehicle  quickly,  one  control  objective  is  to  have  a  fast  slew  rate.  In  addition, 
to  ensure  smooth  motion,  it  is  desired  to  avoid  system  overshoot.  These  objectives  must  be 
accomplished  in  the  presence  of  substantial  parametric  variation  and  system  delay.  Control 
valve  saturation  is  also  a  significant  obstacle.  PID  controllers  are  the  most  commonly  used 
controllers  in  industrial  practice.8  PID  control  was  used  here  due  to  its  simple  structure, 
ease  of  design  and  robustness  under  certain  model  and  parameter  uncertainties.  A  Smith 
predictor  was  used  along  with  PID  control  to  compensate  for  the  system  delay.  An  anti¬ 
windup  strategy  was  used  to  compensate  for  actuator  saturation. 

PID  Control  Using  Tuning  Rules 

Many  PID  tuning  rules  are  available  for  second  order  system  with  time  delay.11  A  direct 
synthesis  method  proposed  by  Miluse  etc.11  was  used  to  obtain  the  PID  gains.  For  0% 
overshoot,  the  proportional  gain,  the  integral  time  constant  and  derivative  time  constant  of 
the  PID  controller  can  be  computed  as  Kp  =  0.736^,  T)  =  2 £T,  and  Td  =  0.5 T/£. 

In  the  first  design  attempt,  the  variation  of  the  system  dynamics  was  neglected,  and  only 
one  PID  controller  was  designed  for  the  entire  operating  region  of  the  system.  Thus  the  model 
parameters  were  taken  as  the  average  of  the  corresponding  parameters  as  given  in  Table  1. 
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The  gains  of  the  obtained  PID  controller  are  Kp  =  2.0615,  Ki  =  1.9872,  and  Kd  =  0.7106. 
The  controller  demonstrated  its  robustness  during  experimental  implementation. 

Smith  Predictor 

As  described  above,  open-loop  system  tests  revealed  the  existence  of  transportation  delay 
in  the  CFTV  system.  A  Smith  predictor  is  an  effective  tool  for  compensating  for  system 
time  delay.  As  shown  in  Figure  8,  the  basic  idea  of  the  Smith  predictor  is  to  use  a  delay 
free  model  of  the  process  dynamics  Gm  to  predict  the  effect  of  current  control  actions  on  the 
actual  delayed  process  output.  Additional  feedback  from  the  actual  process  output  is  then 
used  to  compensate  for  modelling  error  and  process  disturbances.12-14  Here,  the  primary 
controller  used  in  the  Smith  predictor  is  the  PID  controller  designed  above. 

Note  that  the  Smith  predictor  is  very  dependent  on  the  system  model.  To  cope  with  the 
process  parameter  variation,  an  adaptive  Smith  predictor  using  on-line  parameter  estimation 
or  robust  tuning  is  preferred.12,14  In  the  current  implementation,  Gm  is  taken  as  the  average 
dynamics  model. 

Antiwindup 

The  working  range  of  the  control  valve  is  within  [0  5]  volts.  It  was  observed  that  for  the 
PID  controller,  control  valve  saturation  occurred  at  higher  setpoints  where  the  generated 
control  signal  was  higher  than  5  volts.  Saturation  also  occurred  at  the  instant  of  dramatic 
setpoints  change,  where  a  big  change  of  control  signal  was  produced  to  track  the  change  of 
setpoint.  In  addition,  saturation  occurred  in  the  case  of  abnormal  sensor  noise. 

The  performance  of  PID  control  can  be  severely  deteriorated  in  practical  cases  by  the 
presence  of  saturation  of  the  actuators,  which  causes  the  well-known  phenomenon  of  integra¬ 
tor  windup,  leading  to  large  overshoot,  slow  settling  time,  and,  sometimes,  even  instability  in 
the  system.15  The  traditional  method  to  deal  with  the  integrator  windup  problem  is  to  tune 
the  PID  controller  ignoring  the  actuator  saturation  and  subsequently  to  add  an  anti-windup 
compensator  to  prevent  the  degradation  of  performance.15-17 

One  of  the  commonly  used  approaches  is  back-calculation  (or  tracking  anti- windup). 16,17 
As  shown  in  Figure  9,  this  approach  consists  of  recomputing  the  integral  term  once  the 
controller  saturates.  In  particular,  the  integral  value  is  reduced  by  feeding  back  the  difference 
of  the  saturated  us  and  unsaturated  control  signal  u.  Here  Tt  is  the  tracking  time  constant, 
and  its  value  determines  the  rate  at  which  the  integral  term  is  reset;  its  choice  determines 
the  performances  of  the  overall  control  scheme.  Some  suggestions  are  to  set  Tt  =  7$,  but  in 
some  cases  higher  values  may  give  further  improvement  in  performance.16,17 
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Simulation  Results 


Simulations  were  performed  with  four  different  control  approaches,  i.e.,  PID,  PID  with 
Smith  prediction,  PID  with  anti-windup,  and  PID  with  both  Smith  prediction  and  anti¬ 
windup.  The  average  model  obtained  for  PID  control  law  design  was  used  in  the  simulation. 
As  discussed  above,  the  thrust  vector  angle  cannot  be  directly  measured  in  a  practical 
implementation  of  CFTV.  In  the  present  study,  the  corresponding  vector  angles  are  estimated 
based  on  the  nearly  linear  relation  between  the  thrust  vector  angle  and  the  gap  pressure  such 
as  that  shown  in  Figure  9  of  the  reference  paper.4  This  relationship  is  used  here  since  it 
is  based  on  extensive  test  results,  which  demonstrate  that  this  pressure  value  is  a  reliable 
predictor  of  the  vector  angle.  Since  the  pressure  distributions  along  the  collar  obtained 
in  the  present  test  setup  matched  well  with  that  of  the  reference  paper,  the  use  of  the 
previously  established  correlation  is  well-justified.  Consequently,  the  uncertainty  associated 
with  the  present  vector  angles  is  estimated  to  be  similar  to  that  associated  with  previous 
measurements  in  reference,4  and  is  approximately  ±0.5  degrees.  The  comparison  of  the 
controller  performance  was  conducted  under  two  cases:  1)  without  controller  saturation, 
and  2)  with  controller  saturation. 

In  the  first  case,  the  CFTV  system  had  a  setpoint  of  13.75  psi  (corresponding  to  a  5.0 
deg  vector  angle).  In  this  case,  anti- windup  had  no  effect  because  all  the  generated  signals 
were  within  the  working  range  of  the  control  valve  (i.e.,  [0  5]  volts).  As  shown  in  Figure 
10,  the  control  signal  generated  from  the  PID  controller  overlapped  with  that  of  the  PID 
controller  with  the  anti-windup  scheme,  and  the  control  signal  generated  from  the  Smith 
predictor  overlapped  with  the  PID  controller  with  both  the  Smith  predictor  and  the  anti¬ 
windup  scheme.  Likewise,  as  shown  in  Figure  11,  the  output  signal  resulting  from  the  PID 
controller  overlapped  with  that  of  the  PID  controller  with  the  anti-windup  scheme,  and  the 
output  signal  of  the  Smith  predictor  overlapped  with  PID  controller  with  both  the  Smith 
predictor  and  the  anti- windup  scheme.  Since  the  control  signal  generated  by  the  Smith 
predictor  was  less  aggressive  than  the  corresponding  PID  controller,  the  Smith  predictor  did 
not  cause  overshoot  and  the  transient  performance  is  smoother  than  the  corresponding  PID 
controller. 

As  an  example  of  the  second  case,  the  CFTV  system  tracked  a  setpoint  change  from 
14.3  psi  to  12.6  psi  (corresponding  to  an  increase  of  thrust  vector  angle  from  2.0  deg  to  9.2 
deg).  Controller  saturation  occurred  due  to  the  dramatic  change  of  the  setpoint,  and  the 
higher  targeted  setpoint  at  12.6  psi.  Figure  12  shows  the  generated  control  signal  after  the 
change  of  setpoint  at  5  sec.  As  shown  in  the  figure,  the  control  signal  generated  by  the  PID 
controller  was  above  5  volts  over  most  of  the  time  period,  the  control  signal  generated  by  the 
PID  controller  with  the  Smith  predictor  was  smaller  but  went  beyond  5  volts  after  9.2  sec. 
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Anti-windup  had  the  ability  to  avoid  controller  saturation;  as  shown  in  the  figure,  the  control 
signals  generated  by  the  PID  controller  with  the  anti- windup  scheme  and  the  PID  controller 
with  both  the  Smith  predictor  and  the  anti-windup  scheme  were  less  or  equal  to  5  volts.  The 
simulation  was  conducted  with  1/Tt  =  6/1*.  It  was  observed  that  the  higher  the  value  of 
1  /Tt,  the  stronger  the  anti-windup  to  avoid  controller  saturation.  The  simulated  controller 
performance  in  Figure  13  shows  that  with  the  current  choice  of  Tt,  the  Smith  predictor  was 
less  aggressive  than  the  corresponding  PID  anti-windup  controller. 

In  the  simulation  results  the  Smith  predictor  did  not  show  the  desired  advantage  over  the 
PID  controller  in  compensating  for  the  time  delay  and  producing  faster  response  times.  The 
major  reason  for  this  is  that  the  said  to  have  a  dominant  time  delay  if  L  >  5 T.18  Simulations 
were  conducted  with  increased  time  delay  (e.g.,  L  was  increased  to  twice  its  original  value), 
and  it  was  seen  that  for  PID  control  the  longer  time  delay  yielded  a  smaller  phase  margin 
which  led  to  large  overshoot  and  very  oscillatory  behavior.  For  large  enough  time  delay 
(e.g.  when  the  time  delay  was  five  times  its  original  value  for  the  CFTV  system)  the  system 
became  unstable.  However,  the  performance  of  the  Smith  predictor  was  consistent  as  the 
time  delay  increased. 


Experimental  Results 

Extensive  experiments  with  the  four  different  control  approaches  were  conducted  and 
the  performances  of  the  different  approaches  were  compared.  Here,  the  experimental  results 
under  two  types  of  reference  signals  are  given. 

In  the  case  of  a  pulse  reference  signal,  the  desired  collar  gap  pressure  is  12.6  psi  (corre¬ 
sponding  to  9.2  deg  thrust  vector  angle)  from  0  to  20  sec,  14.0  psi  (corresponding  to  3.7  deg 
thrust  vector  angle)  from  20  to  40  sec,  and  it  is  13.0  psi  (corresponding  to  8.0  deg  thrust 
vector  angle)  from  40  to  60  sec.  Figure  14  compares  experimental  outputs  with  different 
control  approaches.  Here  both  the  dramatic  changes  of  reference  signal  (from  12.6  psi  to 
14.0  psi,  and  from  14.0  psi  to  13.0  psi)  and  the  higher  setpoint  (12.6  psi)  led  to  high  control 
signal  demands;  thus  the  PID  controller  always  exhibited  overshoot.  The  PID  controller 
with  the  Smith  predictor  was  always  less  aggressive,  producing  no  overshoot  while  having 
a  slower  rise  time  than  the  PID  controller  alone.  The  PID  controller  with  the  anti-windup 
scheme  had  the  ability  to  remove  the  overshoot  while  obtaining  a  similar  rise  time  to  that 
of  the  PID  controller  alone;  here  Tt  =  T*  was  used.  The  PID  controller  with  both  the  Smith 
predictor  and  anti-windup  scheme  was  less  aggressive  than  the  PID  controller  with  the  Smith 
predictor  or  the  PID  controller  with  the  anti-windup,  having  a  slower  rise  time. 

In  the  case  of  a  sine  wave  reference  signal,  the  desired  collar  gap  pressure  is  described 
by  Pgap  =  0.85,sm(0.l7r£  +  tt/2)  +  13.45,  corresponding  to  a  maximum  thrust  vector  angle 
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of  9.2  deg  and  a  minimum  thrust  vector  angle  of  2.0  deg.  Figure  15  compares  experimental 
outputs  with  different  control  approaches.  Here,  due  to  the  continuous  reference  signal, 
control  saturation  occurred  only  when  the  reference  signal  was  around  12.6  psi  (where  the 
generated  control  signal  was  lighter  above  5  volts)  and  14.3  psi  (where  the  generated  control 
signal  was  slightly  below  0  volt).  The  PID  controller  with  anti- windup  was  very  close  to 
the  PID  controller  except  around  the  instants  of  peak  point  12.6  psi  and  14.3  psi.  The  PID 
controller  with  the  Smith  predictor  was  less  aggressive  and  had  a  slower  response  than  the 
corresponding  PID  controller.  The  PID  controller  with  both  the  Smith  predictor  and  anti¬ 
windup  scheme  was  very  close  to  the  PID  controller  with  the  Smith  predictor.  In  all  the  four 
cases,  the  closed-loop  response  exhibited  obvious  delay  in  tracking  the  reference  signal.  For 
example,  the  delay  time  for  the  PID  controller  to  the  reference  sine  wave  signal  was  about 
1.3  sec. 

In  all  of  the  experimental  results,  the  four  types  of  controllers  demonstrated  performance 
similar  to  the  simulation  results.  In  general,  PID  control  with  a  Smith  predictor  eliminated 
the  overshoot  of  the  PID  controller  but  increased  the  rise  time  and  did  not  avoid  controller 
saturation.  PID  control  with  anti- windup  was  effective  in  the  presence  of  controller  satu¬ 
ration.  PID  control  with  both  a  Smith  predictor  and  anti-windup  scheme  did  not  show  an 
advantage  over  PID  control  with  only  anti-windup.  One  reason  for  this  is  that,  as  discussed 
above,  for  a  system  such  as  CFTV  that  is  not  time  delay  dominant,  a  Smith  predictor  shows 
little  or  no  advantage.  In  addition,  a  Smith  predictor  is  model-based,  and  the  estimated 
model  may  be  significantly  different  from  the  true  CFTV  model. 

A  PID  controller  with  anti-windup  is  preferred  in  the  current  controller  design.  Extensive 
experimental  results  demonstrated  the  robustness  of  the  PID  controller  under  system  un¬ 
certainties.  However  to  further  improve  the  system  performance,  an  adaptive  scheme  which 
can  update  the  system  parameters  and  control  parameters  online  should  be  investigated. 

CONCLUSIONS 

Counterflow  thrust  vectoring  control  is  a  promising  technique  for  aircraft  engine  attitude 
control.  Feedback  control  of  CFTV  is  needed  to  obtain  desired  thrust  vector  angles  by 
compensating  for  the  transportation  delay  and  parameter  uncertainties. 

This  paper  has  described  an  experimental  testbed  for  investigating  feedback  control  of 
CFTV.  System  modelling  was  achieved  using  open-loop  test  data.  A  PID  controller  was 
developed  for  the  system  and  was  sometimes  implemented  with  a  Smith  predictor  and/or  an 
anti-windup  scheme.  Then  the  performances  of  the  PID  controller,  the  PID  controller  with 
the  Smith  predictor,  the  PID  controller  with  the  anti-windup  scheme,  and  the  PID  controller 
with  both  the  Smith  predictor  and  the  anti- windup  scheme  were  compared  by  both  simulation 
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and  experimentation.  Both  simulation  and  experimental  results  demonstrated  that  the  PID 
controller  with  anti-windup  was  the  most  effective  control  scheme. 

This  paper  studied  feedback  control  of  one  dimensional  CFTV  where  only  the  pitch 
vectoring  was  considered.  Open-loop,  three  dimensional  CFTV  has  been  demonstrated  in 
a  laboratory  setting.  Feedback  control  of  the  three  dimensional  CFTV  will  result  in  a 
multivariable  control  problem  and  hence  is  significantly  more  difficult  than  the  corresponding 
single-input,  single-output  control  problem  considered  here.  The  multivariable  case  will  be 
studied  in  future  research. 
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Input  Amplitude  (volts) 

K 

T  (sec) 

a 

L  (sec) 

1 

0.2889 

0.6681 

0.9181 

0.5440 

2 

0.3258 

0.5089 

0.8650 

0.5543 

3 

0.3365 

0.5033 

0.8504 

0.5730 

4 

0.3501 

0.6420 

0.8626 

0.5458 

5 

0.3602 

0.6675 

0.8372 

0.5694 

Average  Value 

0.3323 

0.5980 

0.8667 

0.5573 

Table  1: 
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Input  Amplitude  (volts) 

K 

1 

0.3500 

2 

0.3352 

3 

0.3171 

4 

0.3232 

5 

0.3401 

Average 

0.3331 

Table  2: 
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Appendix  B:  “Robust  Fault  Detection  and  Isolation  Using  Robust  h  Estimation”  [7] 


Robust  Fault  Detection  and  Isolation 
Using  Robust  t\  Estimation 

Tramone  D.  Curry*  and  Emmanuel  G.  Collins,  Jr.* 

Florida  A&M  University- Florida  State  University,  Tallahassee,  FL  32310 

Abstract 

This  paper  considers  the  application  of  robust  £\  estimation  to  robust  fault  detection 
and  isolation.  This  is  accomplished  by  developing  a  series,  or  bank,  of  robust  estimators 
(full-order  observers),  each  of  which  is  designed  such  that  the  residual  will  be  sensitive  to  a 
certain  fault  (or  faults)  while  insensitive  to  the  remaining  faults.  Robustness  is  incorporated 
by  assuring  that  the  residual  remains  insensitive  to  exogenous  disturbances  as  well  as  mod¬ 
eling  uncertainty.  Mixed  structured  singular  value  and  t\  theories  are  used  to  develop  the 
appropriate  threshold  logic  to  evaluate  the  outputs  of  the  estimators  used  for  determining 
the  occurrence  and  location  of  a  fault.  A  real-coded  genetic  algorithm  is  used  to  obtain 
the  estimator  gain  matrices.  This  approach  to  FDI  is  successfully  demonstrated  using  a 
linearized  model  of  a  jet  engine. 

‘FAMU-FSU  College  of  Engineering,  Department  of  Mechanical  Engineering 
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Nomenclature 


K,C,Z+ 

real  numbers,  complex  numbers, 
nonnegative  integers 

gmxn 

m  x  n  real  matrices,  complex 

matrices 

VnJ^nVn 

n  x  n  real  diagonal,  nonnegative 
definite,  positive  definite  matrices 

o,  I 

zero  matrix,  identity  matrix 

tr 

trace 

A/2  ^  My 

M2  —  Mi  positive  definite 

M2  My 

A/2  —  Mi  nonnegative  definite 

dim(A/) 

dimension  of  M 

N-)Hoo,2 

esssupt>0  |jz(/)||2 

IK')  ||(oo,2),  [Wo,  N] 

esssupi€[WoT>WT]  ||z(£)||2 

\\Hzw\\i 

suPu;(-)eroo  imu.2 

Zij 

(i,j)  element  of  matrix  Z 

Vec(z),  z  e  nmxn 

[•^ll  >  ■  ■  *  7  Zml  1  Zi2,  •  *  ■  >  Zm2,  .  .  . 

diag(Z),  Z  €  T>n 

[zn,  Z22,  ...,  znn}T 

Introduction 

In  modern  systems  such  as  aircraft  and  spacecraft,  there  is  an  increasing  demand  for  reli¬ 
ability  and  safety.  For  example,  a  jet  engine  is  very  critical  for  an  aircraft  and  if  faults  occur, 
the  consequences  can  be  extremely  serious.1  Many  dynamic  systems  are  complex  technical 
systems  that  involve  extensive  use  of  multiple  sensors,  actuators  and  other  system  compo¬ 
nents,  any  one  of  which  could  fail  or  deteriorate.  Hence,  health  monitoring  and  supervision 
of  these  systems  is  essential  for  the  improvement  of  reliability,  safety  and  dependability  of 
operations.  This  entails  continuously  checking  a  physical  system  for  faults  and  taking  ap¬ 
propriate  actions  to  maintain  the  operation  in  such  situations.  In  particular,  the  objective 
is  to  detect  and  isolate  failures  or  anomalies  in  the  sensors,  actuators  and  components. 

One  of  the  primary  approaches  to  model-based,  fault  detection  and  isolation  uses  state 
or  output  estimators.2-8  Detection  of  a  fault  is  achieved  by  comparing  the  actual  behavior 
of  the  plant  to  that  expected  on  the  basis  of  the  model;  deviations  are  indications  of  a  fault 
(or  disturbances,  noise  or  modeling  errors).9  Fault  isolation  can  be  achieved  by  dedicating 
an  estimator  such  that  the  residual  is  sensitive  to  only  one  particular  fault.  In  particular, 
referring  to  Figure  1,  a  bank  of  estimators  is  used  to  generate  residuals  r(t).  These  residuals 
are  then  analyzed  by  some  appropriate  logic  (e.g.,  logic  based  on  thresholds  or  fuzzy  logic) 
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which  infers  whether  faults  have  occurred  (fault  detection)  and  where  they  have  occurred 
(fault  isolation). 

In  many  approaches  to  the  FDI  problem  the  robustness  aspect  is  commonly  introduced 
in  relation  to  the  fault  detection.10  The  estimators  shown  in  Figure  1  may  be  designed  in  a 
variety  of  ways,  for  example  by  using  Kalman  filter  theory  (i.e.,  H2  optimal  estimation),11-13 
H0 o  theory,14-16  or  theory.17-19  Whichever  method  is  used  for  designing  the  estimator, 
it  will  use  an  idealized  mathematical  description  of  the  underlying  plant.  In  practice  this 
model  of  the  plant  is  never  totally  accurate,  which  can  degrade  the  quality  of  the  residuals 
produced  by  the  estimators.  The  errors  in  the  plant  model  may  be  either  parametric  or 
unstructured  (e.g.,  unmodeled  dynamics).  To  reduce  the  degradation  in  the  quality  of  the 
residuals  upon  which  the  FDI  process  is  based,  and  hence  to  reduce  the  false  alarm  rate,  it 
is  imperative  that  the  plant  uncertainty  be  explicitly  taken  into  account  in  the  design  of  the 
estimators. 

Until  recent  work,11,14,18,20  the  relatively  nonconservative  mixed  structured  singular  value 
(MSSV)  techniques21-24  had  not  been  applied  to  robust  estimation,  although  more  conser¬ 
vative  techniques,  based  on  the  small  gain  theorem  or  fixed  quadratic  Lyapunov  functions, 
had  been  used.15,16,25-27  Conservatism  in  robustness  theory  involves  how  the  theory  actu¬ 
ally  models  the  uncertainty.  For  example,  even  if  the  uncertainty  is  real  and  parametric, 
the  small  gain  theorem  assumes  that  the  uncertainty  is  complex  and  unstructured.  Like¬ 
wise,  fixed  quadratic  Lyapunov  function  theory  assumes  that  the  uncertainty  is  arbitrarily 
time-varying.  MSSV  theory,  which  considers  both  parametric  uncertainty  and  unmodelled 
dynamics,  allows  real  parametric  uncertainty  to  be  treated  as  slowly  time- varying,  real  para¬ 
metric  uncertainty,  which  is  a  much  less  conservative  model.  The  reduced  conservatism 
allows  the  estimators  to  be  used  for  more  accurate  fault  detection.  Specifically,  the  fixed 
thresholds  are  smaller,  allowing  the  detection  of  smaller  faults.  With  more  conservative  the¬ 
ories  the  thresholds  are  larger,  causing  some  smaller  faults  to  go  undetected.  Although  the 
example  in  this  paper  focuses  exclusively  on  sensor  faults  the  theory  is  developed  to  include 
actuator  faults  as  well. 

This  paper  considers  the  application  of  robust  l\  estimation  to  fault  robust  fault  detec¬ 
tion  and  isolation.  This  is  accomplished  by  developing  a  series,  or  bank,  of  robust  estimators 
(full-order  observers),  each  of  which  is  designed  such  that  the  residual  will  be  sensitive  to  a 
certain  fault  (or  faults)  while  insensitive  to  the  remaining  faults.  Robustness  is  incorporated 
by  assuring  that  the  residual  remains  insensitive  to  exogenous  disturbances  as  well  as  mod¬ 
elling  uncertainty.  Mixed  structured  singular  value  and  t\  theories  are  used  to  develop  the 
appropriate  threshold  logic  to  evaluate  the  outputs  of  the  estimators  used  for  determining 
the  occurrence  and  location  of  a  fault.  A  real-coded  genetic  algorithm  is  used  to  obtain  the 
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estimator  gain  matrices.  The  effectiveness  of  this  robust  FDI  technique  is  illustrated  as  it 
is  applied  to  a  discrete-time,  linear  uncertain  model  of  an  advanced  afterburning  turbofan 
engine. 

The  organization  of  this  paper  is  as  follows.  Section  2  presents  the  formulation  of  the 
closed-loop  uncertain  system  to  which  estimation  will  be  applied.  The  application  of  robust 
ti  estimation  to  robust  fault  detection  and  isolation  is  presented  in  Section  3.  Section  4 
discusses  results  of  an  illustrative  example  of  a  jet  engine,  while  Section  5  gives  concluding 
remarks. 


Robust  Estimation 

Consider  a  discrete-time,  linear  uncertain  dynamic  system 

x(k  +  1)  =  (A  -I-  A A)x(k)  +  Bu(k)  +  -Doo,iu>oo(&),  k  E  Z+  (1) 

y(k)  =  (C  +  A  C)x(k)  +  Du(k )  +  DoofiWooik),  (2) 

z(k )  =  Eoax(k),  (3) 

where  x  E  1Zn  is  the  state  vector,  u  E  lZd  is  the  control  input,  y  E  TZP  denotes  the  plant 
measurements,  z  E  TZq  is  the  performance  output  to  be  estimated,  and  E  TZdo°  denotes 

an  £oo  disturbance  signal  satisfying  ||ro00(-)||00i2  <  1.  The  uncertainties  AA,  A B  and  AC 

satisfy 


AAeUa±  {AAEKn*n  :  AA  =  -HaFaGa,  FaeTa },  (4) 

AC  EUC  =  {AC  EUpxn  :  AC  ^  -HcFcGc,  Fc  E  Fc},  (5) 

where 

Ta  4  {Fa  E  Vr  :  Maa  <Fa<  MAt2},  (6) 

Fc  =  {Fc  G  V1 :  Mc,\  <  Fc  <  Mc,2},  (7) 

with  Maa,  Ma  2  G  T>r,  Mc,i,  Me, 2  G  T> l,  MA,2  —  MAA  >  0,  and  Me, 2  ~  Me,  1  ^  0. 

It  is  desired  to  design  a  full-order  observer  of  the  form 

xe(k  +  l|jfc)  =Aexe{k\k  -  1)  +  [B  -  WD)u(k)  +  W[y{k)  -  Cxe{k\k  -  1)]  (8) 


to  estimate  the  state  vector  x,  where  W  E  7ZnXp  and  Ae  E  TZnxn  are  the  parameters  to  be 
determined. 
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The  state  estimation  error  is  defined  as 


e{k)  =  x(k )  -  xe(k\k  -  1),  (9) 

which  using  (1),  (2),  and  (8)  can  be  shown  to  obey  the  evolution  equation 

e(k  +  1)  =  (Ae  -  WC)e(k)  +  (A-Ae  +  AA-  WAC)x{k)  +  (D^  -  WD^w^k). 

(10) 

Now  define  the  error  output  z  €  TV”  as  z(k)  =  £’0Oe(A:).  Then  augmenting  (1)  with  (10) 
yields 


x(k  +  1)  =  {A  +  AA)x(k)  +  Diw^k), 
z(k)  =  Ex(k), 


where 


x(k)  = 


x(k) 

e{k) 


o 

,  A  = 

A  -  Ae  Ae  -  WC 

Doo,l 

Doo,l  ~  WDoafi 


E  = 


Furthermore,  A  A  satisfies 


(11) 

(12) 


(13) 


AA  €Ua  =  {A  A  €  Tl2nx2n  :  A  A  =  -HaFaGa,  Fa  €  FA}, 
fA  A  {Fa  €  Vr+t  :  Mi  <  FA  <  M2}, 


(14) 

(15) 


where 


and 


Fa  — 


'  Fa 

0 

0 

pc. 

>  ha  = 

Ha  0 
Ha  -WHc 


,  GA  = 


Ga  0 
Gc  0 


Mi  =  diag(MA1,  Mc,i),  M2  =  diag(M,ii2,  Mc,2). 


(16) 

(17) 


The  robust  l\  estimation  problem  is  to  find  the  estimator  parameters  Ae  and  W  such 
that  the  combined  system  (8),  (11)-(12)  is  asymptotically  stable  and  the  cost  functional 


J(W)  =  \\Hzw\\2 


(18) 
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is  minimized,  where  Hzw  is  the  the  convolution  operator  from  the  disturbance  rcoo(-)  to  the 
performance  variable  z(-). 

As  shown  in,28  direct  minimization  of  the  l\  norm  can  lead  to  irrational  estimators. 
However,  Haddad  et.  al.29  shows  it  is  possible  to  characterize  an  upper  bound  on  the  l\ 
performance.  For  some  uncertainty  set  U  C  7£nxn,  A ,4  E  U,  x  E  TZn,  z  E  IZq  w0O(-)  E  7Zdo°, 
the  l\  performance  bound  as  a  function  of  AA  is  given  in  the  following  proposition 

Proposition  1  Let  a  >  1  and  assume  there  exists  a  positive-definite  matrix  Qaa  satisfying 

Qaa  =  a(A  +  A  A)QaA(A  +  A  A)T  +  (19) 

a  —  1 

where  —  D\Dj .  Then  A  +  AA  is  asymptotically  stable.  Furthermore,  the  t\  norm  of  the 
convolution  operator  Hzw  from  disturbances  tc(-)  to  the  performance  variable  z(-)  satisfies 
the  bound 

\\HZW\\\  <  sup  [ tr\EQAAETy ]i,  A  A  E  U.  (20) 

A  Aeu 

If,  in  addition,  a  is  chosen  such  that  \fa(A  +  AA)  is  asymptotically  stable,  then  the  existence 
of  a  positive- definite  solution  Qaa  is  guaranteed. 

Proof.  Follows  from  Lemma  in.18 

Remark  1  Minimization  of  the  upper  bound  is  a  more  appropriate  approach  than  some 
conventional  methods.  Typical  linear  programming  methods30  that  seek  to  directly  minimize 
the  I\  norm  do  not  allow  a  fixed  architecture  estimator  or  controller  design.  These  methods 
normally  result  in  very  high  order  estimators  or  controllers,  which  are  not  practical  for 
implementation. 

In  order  to  obtain  an  upper  bound  on  the  I\  performance  ||i/zu,||2  over  the  entire  uncer¬ 
tainty  set  U ,  a  multiplier  framework  will  be  used  to  bound  Qaa  for  all  AA  E  U  where 

U  =  {AA  E  n2nx2n  :  AA  =  -H0FG0,  FeT).  (21) 

Let  G(z )  E  Cqxd°°  be  the  transfer  function  representation  of  the  system  described  in  (11) 
and  (12).  The  Popov-Tsypkin  multiplier11, 14,18,24  has  the  transfer  function  form 

M{z)  =  H  +  NZ-^,  (22) 

where  H  E  Dm,  N  E  T>m  (m  =  r  + 1)  with  H  >  0  and  N  >  0.  Let  Aa  denote  the  state 
matrix  of  the  augmented  system  M(z)G(z).  Then,  the  uncertain  system  for  robust  analysis 
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is  given  by31 


xa(k  +  1)  =(Aa  +  AAa)xa(k )  +  Da^Wooik), 
z(k )  =Eaxa(k), 

where  xa(k )  =  [xJn(k)xT (k)]T ,  xm{k)  €  TZm  denotes  the  states  of  the  multiplier, 


_  0° 

H0  A  ’  a'°°~ 


;J, «.-[«  e  ] , 


where 


A Aa  eUaA  {AAa  e  nm+n  :  AAa  =  - HaFGa ,  F  €  F}, 


Hn  = 


,  Ga=  [ 


Note  that  the  uncertainty  set  U  in  (21)  is  a  subset  of  Ua.  The  next  theorem  provides  an 
upper  bound  for  the  i\  performance  for  all  AAa  6  Ua. 

Theorem  1  Let  a  >  1,  q  >  1.  Suppose  there  exists  H  6  Vn,  N  €  J\fn  and  Qa  >  0  such 
that  2 H(Mi  —  Mx)~l  —  GaQaGa  >  0,  and  Qa  satisfies  the  algebraic  Riccati  equation 

Qa  =  a(Aa  -  HaM\G a)Qa[Aa  -  HaMiGa)T  +  [^{Aa  -  HaMiGa)QaCj  -  V^Ba{H  +  N ) 
+  SaN][2H{M2  -  M1)~1  -  GaQaGlj-'iyfciAa  -  HaMlGa)QaCl  -  +  N) 

+  SaN]T  +  -^14,00,  (28) 


a  —  1 


where  14, oo  —  T4,<x>£^oo  and  Sa~  ,  where  dim(5a)  =  dim(/fa). 


Then, 


LX  1 

UAa  +  A>la),  f - -Va  oo] 5 }  is  stabilizable,  AA  €  U, 

a  —  1 


if  and  only  if  (Aa  +  AAa)  is  asymptotically  stable  for  each  AAa  6  Ua  and  in  this  case,  the 
i\  performance  \\HZW\\^  is  bounded  as 

\\Hzw\\\<[triEaQaEly}K  AAaeUa.  (30) 


Proof.  The  proof  can  be  completed  in  the  same  manner  as  proof  to  results  in.23 
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Robust  FDI  Using  Robust  £i  Estimation 

Now  consider  the  fault  driven  system 

x(k  +  1)  =  (A  +  AA)x{k)  +  Bu(k )  +  D^w^k)  +  Rafa(k),  (31) 

y(k)  =  (C  +  A  C)x(k)  +  Dpu(k )  +  D^w^ik)  +  Rsfs(k),  (32) 

z(k)  =  Eaox(k),  (33) 

where  /„  €  7 ZTa  and  fs  €  W’  are  the  actuator  and  sensor  fault  vectors,  respectively.  The 
fault  distribution  matrices  Ra  and  Rs  are  assumed  to  be  known.  Defining  /  A  [yj  /J]T 
yields  the  modified  system 


x(k  +  1)  =  (A  +  AA)x(k)  +  Bu(k)  +  D^w^k)  +  Rif(k),  (34) 

y(k )  =  (C  +  A  C)x(k)  +  DoofiWooik)  +  R2f{k),  (35) 

z(k)  =  Eoc>x(k),  (36) 

where 

=  [  Ra  o  ]  ,  R2  =  [  0  Rs  ]  .  (37) 

Equations  (34)- (35)  can  be  written  in  the  expanded  forms 

x(k  +  1)  =  (A  +  AA)x(k)  +  Bu(k )  +  D^w^ik)  +  Ri,ifi{k)  +  . . .  +  Rhgfg(k),  (38) 

y(k )  =  (C  +  A C)x(k)  +  D00t2'fc00(fc)  +  R2}ifi(k)  +  . . .  +  i?2,ff/g(&),  (39) 


where  Rij  (respectively,  R2ii)  denotes  the  ith  column  of  the  matrix  Ri  (respectively,  R2)- 
Let  g  =  ra  +  rs.  For  i  €  {1, 2, . . .  ,g}  the  term  fi(k)  represents  the  ith  individual  fault  of  f(k ) 
and  Riti  (respectively,  R2ti)  represents  its  directional  characteristics.  Assume  that  fi(k)  is 
the  “target  fault,”  i.e.,  the  fault  that  it  is  desired  to  detect.  Without  loss  of  generality,  the 
vector  of  “nuisance  faults”,  representing  the  faults  that  are  not  to  be  detected  (by  the  robust 
fault  detection  filter),  is  given  by  A  [/i(A:)  •  •  •  fi-i(k)  fi+1(k)  ■  ■  ■  fg(k)}.  Hence,  (38)-(39) 
can  be  replaced  by 

x(k  +  1)  =  (A  +  AA)x(k)  +  Bu(k)  +  D^Wooik)  +  R1}ifi(k )  +  RltJi(k),  (40) 

y(k)  =  (C  +  AC)x(k)  +  DeopWooik)  +  R2,ifi(k )  +  R2,ifi(k).  (41) 
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Define  w  =  [wT  f[}T .  Then,  (40)  and  (41)  can  be  written  as  a  set  of  systems 


I1 


(k  +  1)  —  (A  +  AA)x(k')  +  Bu{k)  +  D\w[Jz)  +  -Ri,i/i(A:), 
y(k)  =  Cx(k )  +  D2w{k)  +  R2lifi(k), 
z(k )  =  E00x(k) 


(42) 


where 


A  = 


D, 


00,1 


R 


A  = 


D, 


00,2 


R. 


■2,i 


(43) 


It  is  desired  to  design  a  bank  of  full-order  observers  (corresponding  to  each  faulty  system) 
described  in  (8)  to  estimate  the  performance  output  Eaox(k).  As  previously  stated,  Ae  G 
7Znxn  and  W  G  7 Znxp  are  the  parameters  to  be  determined.  (Typically,  one  chooses  Eqo  =  C 
such  that  z  corresponds  to  the  noise  and  fault  free  output  associated  with  the  measurement 
y.)  Detection  of  a  fault  is  achieved  by  comparing  the  actual  behavior  of  the  plant  to  the 
the  output  of  the  estimators;  deviations  are  indications  of  a  fault  (or  disturbances,  noise  or 
modeling  errors). 

Let  the  residual  error  be  defined  as 


r(k)  =  P[y(k )  -  Cxe{k\k  -  1))  -  Du{k)},  (44) 

where  the  g  x  p  gain  matrix  P32  is  chosen  such  that  r  has  a  fixed  direction  when  responding 
to  the  target  fault.  Fault  isolation  can  be  achieved  by  designing  an  estimator  such  that 
estimation  error  (i.e.  the  residual)  is  sensitive  to  only  one  particular  fault.  Specifically,  each 
is  designed  to  be  sensitive  to  a  particular  fault  and  insensitive  to  the  remaining  faults.  In 
addition,  these  estimators  are  made  robust  against  exogenous  disturbances  and  modeling 
uncertainties.  Referring  to  Figure  1,  the  bank  of  estimators  is  used  to  generate  residuals 
r(k).  These  residuals  are  then  analyzed  by  some  appropriate  logic  (e.g.,  logic  based  on 
thresholds)  which  infers  whether  faults  have  occurred  (fault  detection)  and  where  they  have 
occurred  (fault  isolation). 

Using  (42),  the  state  estimation  error  in  (9)  can  be  shown  to  obey  the  evolution  equation 

e(k  +  1)  =(Ae  -  WC)e(k)  +  (A  +  AA-  WAC  -  Ae)x(k) 

+  (A  -  WD2)Woo{k)  +  (Rhi  -  WR2ii)fi(k).  (45) 
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Augmenting  (42)  with  (45)  yields 


(46) 

(47) 


x(k  +  1)  =  (A  +  AA)x{k)  +  Awoo(fc)  +  Rifi(k), 
z(k )  =  Ex(k), 

where 


Let  Jrw  represent  the  l\  norm  of  the  system  operator  from  the  disturbance  vector  w 
to  the  residual  r  and  let  Jrf  represent  the  i\  norm  of  the  system  operator  from  the  target 
fault  fi  to  the  residual  r.  Following  previous  derivations,  it  is  possible  to  characterize  upper 
bounds  Jrw  and  Jrj  such  that 


Jrtu  =  ||#rj?  <  JrW,  (49) 

Jrf=\\Hrf\\\<Jrf.  (50) 

Using  multiplier  theory,  the  uncertain  system  is  given  by 

xa{k  +  1)  ~(Aa  +  AAa)xa(k)  +  DaiWw(k)  -f  Dajfi(k),  (51) 

z(k)  =Eaxa(k),  (52) 

where  xa(k )  =  [x'fn(k)  xT(k)]T  and  xm(k)  €  7lm  is  as  previously  described.  The  t\  perfor¬ 
mance  functions  then  have  the  bounds, 

Jrw(Ae,W,P,H,N)  =  [tr  {EaQa,wETaf}\,  (53) 

Jrf(Ae,  W,  P,  H ,  N)  =  MEaQa<fEly}\,  AAa  e  Ua,  (54) 


Curry  and  Collins 


10  of  34 


where  Qa<w  and  Qaj  satisfy  the  algebraic  Riccati  equations 


Qa,W  =  a(Aa  -  HaMiGa)Qa,w(Aa  ~  HaM1Ga)T  +  [MAa  -  HaMiG a) Qa<w Cj 

-  sfaHa(H  +  N)  +  SaN}[2H{M2  -  Mj)"1  -  GaQ^G^-'iMA  -  //aM1G'0)Q0,U)Cj 

-  y/^Ha(H  +  N)  +  SaN]T  + Va,w,  (55) 

a  —  1 

QaJ  =  a(Aa  -  HaMiGa)Qa,f(Aa  -  H^Gaf  +  [yfc{Aa  -  HaMxGa)QaJCl 

-  y/aHa{H  +  N)  +  SaN}[2H(M2  -  M 1)~1  -  GaQajG^iMA  ~  HaM1Ga)QaJCj 

-  yfcHa{H  +  N)  +  SaN]T  +  (56) 


,  with  dim(5a)  =  dim(//a). 


where  Va>w  4  Da,wD£, w,  VaJ  4  DaJDTa<f,  and  5a  4 

Robust  FDI  filter  design  may  be  approached  by  choosing  Aet  W  and  P  such  that  Jrw  is 
small  and  Jrj  is  large.1  A  minimization  problem  that  expresses  this  objective  is 


min 

A',W,P 


J  =  PJrW  +  (l-P)^-+^, 

Jrf  Jrf 


(57) 


where  /?  €  [0, 1]  and  7  >  0  are  arbitrarily  chosen  weighting  scalars.  With  an  enforced  stability 
constraint,  this  optimization  problem  can  be  solved  using  a  real-coded  genetic  algorithm,  as 
discussed  in  the  next  section. 

Now  consider  the  set  of  uncertain,  discrete-time  systems 


x{k  +  1)  =  (A  +  A A)x(k)  -f  DiWoo(k)  +  R\tifi(k),  (58) 

y{k)  -  Cx(k)  +  D2Woo{k)  +  R2,ifi(k),  (59) 

z(k)  =  E00x(k),  (60) 


where  x ,  y,  w,  and  /,  are  as  previously  discussed.  The  robust  fault  detection  problem 
is  to  generate  a  set  robust  residual  signals  r(k )  that  satisfy 

llr(^)llp  <  Jth  if  fi{k)  =  0,  (61) 

||r(fc)||p  >  Jth  if  fi(k)  +  0,  (62) 

where  ||  •  ||p  denotes  the  p  norm  of  a  Lebesgue  signal  and  Jth  is  the  ith  threshold  value.  If 

1  It  would  be  more  desirable  to  make  a  lower  bound  on  Jr /  large.  Unfortunately,  lower  bounds  are  usually  much  more 
difficult  to  work  with  computationally  than  upper  bounds. 
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the  filters  (8)  are  applied  to  (58)-(59)  and  Ex  is  chosen  as  C,  (44)  can  be  written  as 


r(k)  =  Pz(k)  +  PD2w00(k)  +  PR2,ifi(k).  (63) 

As  derived  in,18  if  fi(k )  =  0  (63)  satisfies  the  norm  inequality 

lkll(oo,2),[w„,w]  <{MPEaQa,wETaPTy}\  +  2am^(PD2)[tv(PEaQa^PT)^ 

+  ^max(PD2)}\\w\\l00i2) 

,\N0  ,W]>  (64) 

where  Qa,w  is  previously  defined.  The  threshold  can  be  chosen  as 

Jth  — {[tr(P  EaQatWE^  PT)q\  \  +  2amax(PD2)  [tr(P  EaQawEj  PT)q]  h 

+  <Tmax('f>'^)2)}||ui||^oo,2),[JVo,W)-  (65) 

Robust  fault  detection  can  be  accomplished  by  comparing  ||r||(OO|2),[w0,.fv]  with  Jt/t.  A  fault 
occurs  if  ||r||(oOt2)i[W0|W]  >  Jth,  i.e., 


Ik||(oo,2),[wo,w]  >  Jth=>  a  fault  occurred.  (66) 

Optimization  Using  a  Real-Coded  Genetic  Algorithm 

As  previously  discussed,  the  design  of  robust  FDI  estimators  is  formulated  as  an  opti¬ 
mization  problem.  A  real-coded  genetic  algorithm  (RCGA)  is  used  to  search  for  a  solution. 
Genetic  algorithms  (GAs)  can  efficiently  search  in  complex  and  possibly  discontinuous  solu¬ 
tion  spaces  without  problem  reformulation  or  evaluation  of  each  solution  candidate.  They 
offer  the  following  additional  advantages  over  traditional  methods:  (1)  information  about 
derivatives,  Hessians  or  step  sizes  is  not  required,  (2)  a  population  of  points  in  the  solution 
space  is  searched  in  parallel  rather  than  point  by  point,  and  (3)  a  number  of  potential  so¬ 
lutions  to  a  given  problem  can  be  provided.  GAs  have  been  proven  to  provide  efficiency 
(i.e.  faster  computation  times  and  smaller  storage)  and  flexibility  (i.e.  adaptation  to  a  range 
of  complex  problems)  in  comparison  to  traditional  methods  of  optimization.  The  use  of 
RCGAs,  where  operations  are  performed  with  real  numbers,  rather  than  binary  GAs,  where 
binary  digits  are  used,  proves  to  be  more  advantageous.  Because  no  coding  or  decoding  of 
binary  numbers  is  necessary  a  subsequent  decrease  in  computational  time  and  storage  size 
is  achieved. 

An  RCGA  begins  with  an  arbitrarily  chosen  initial  population  within  the  search  region. 
The  algorithm  then  follows  three  general  operations:  (1)  selection ,  (2)  recombination ,  and 
(3)  mutation.33'36  The  flowchart  for  a  single  population  RCGA  is  shown  in  Figure  2. 
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Selection.  A  common  selection  process  in  RCGAs  is  conducted  using  stochastic  universal 
sampling.35  Individuals  of  a  population  are  mapped  to  a  line  segment,  such  that  each 
individual’s  segment  is  equal  in  size  to  its  normalized  fitness  value.  Then,  N  equally  spaced 
pointers  are  placed  along  the  line  segment,  where  N  is  the  number  of  individuals  to  be 
selected.  The  position  of  the  first  pointer  is  determined  by  a  randomly  generated  number 
p  G  [0,  jf]  where  jj  is  the  spacing  between  pointers.  This  method  of  selection  is  analogous  to 
roulette  wheel  selection34  and  is  illustrated  in  Figure  3  for  a  population  of  8  individuals,  n,-, 
with  N  =  4.  From  this  example  it  can  be  seen  that  individuals  n 2,  n3,  n5  and  n7  are  chosen. 

Recombination.  In  an  RCGA  recombination  is  parallel  to  crossover  in  a  binary  GA. 
It  is  the  process  by  which  new  chromosomes  are  produced  from  existing  ones  and  involves 
the  exchange  of  the  individuals’  numeric  values  (genes).35,36  Let  pi  and  p2  represent  two 
individuals  (parents)  who  are  to  reproduce.  The  offspring  p[  and  p'2  are  produced  as  a  linear 
combination  of  the  parents: 

p\  =  ap j  +  (1  -  a)p2,  (67) 

p'2  =  (1  “  a)V\  +  a>p2,  (68) 


where  a  G  [0, 1]  is  a  recombination  parameter. 

Mutation.  The  mutation  process  was  originally  developed  for  binary  representation. 
However,  other  methods  have  been  developed  to  allow  gene  modification  in  an  RCGA.  The 
mutation  operation  randomly  alters  one  or  more  genes  of  a  selected  chromosome.  More 
specifically,  randomly  generated  values  are  added  to  the  genes  with  low  probability.  The 
probability  of  mutation  is  inversely  proportional  to  the  number  of  variables  (dimensions). 
The  more  dimensions  an  individual  has,  the  smaller  the  mutation  probability.35  An  effective 
mutation  operator,  which  produces  small  step  sizes  with  a  high  probability  and  large  step 
sizes  with  a  low  probability,  is  defined  as 

Gen™ut  =  Gerii  +  s^di,  i  G  {1, 2, . . . ,  m}  uniform  at  random  (69) 

Si  G  { — 1,  Tl},  uniform  at  random  (70) 

=  2~uk,  u  G  [0, 1],  uniform  at  random  (71) 

where  s,  r,  and  a  are  direction,  mutation  range,  and  relative  step  size,  respectively,  and  m 
is  the  number  of  genes  in  the  chromosome.  The  mutation  range  is  defined  in  terms  of  the 
domain  of  the  genes,  and  the  step  size  is  defined  in  terms  of  the  mutation  precision  k. 

For  the  robust  l\  optimization  problem  the  chromosome  is  constructed  by  formulating 


Curry  and  Collins 


13  of  34 


matrices  Ae,  W,  P ,  H  and  N  into  a  single  vector  0  such  that 


0=  Vec(Ae)T  Vec(W)T  Vec(P)T  diag{H)T  diag{N)T 


(72) 


The  search  region  is  then  defined  by  establishing  upper  and  lower  limits  0  and  0  such  that 


0tj  <  %  <  Oij. 


(73) 


To  account  for  the  stability  criteria,  the  RCGA  is  formulated  as  a  constrained  optimiza¬ 
tion  problem.  This  is  achieved  by  imposing  a  constraint  on  the  cost  with  a  penalty  function. 
Specifically,  if  the  stability  criterion  is  not  satisfied,  a  multiplicative  penalty  is  imposed  on 
the  cost  such  that 

f max[Aj(Aa)]  <1,  J  =  J 


otherwise, 


J  =  penalty  *  J 


(74) 


where  A*,  i  G  (1,2,  ...,m  +  2n)  are  the  eigenvalues  of  the  augmented  system  Aa.  Using 
this  type  of  penalty  helps  to  insure  that,  because  of  fitness  values,  individuals  representing 
unstable  systems  will  not  survive  the  selection  process.  The  penalty  is  chosen  as  100  such 
that  the  unstable  fitness  values  will  be  two  orders  of  magnitude  larger  than  their  true  values. 


Illustrative  Example  of  FDI  for  a  Jet  Engine 

A  numerical  example  is  presented  in  this  section  to  illustrate  robust  t\  estimator  design 
using  the  Popov-Tsypkin  multiplier  and  the  application  of  the  robust  l\  estimator  to  robust 
fault  detection  of  dynamic  systems.  The  model  used  was  supplied  by  NASA  Glenn  Research 
Center  and  is  given  as 

x(k  +  1)  =  (A  +  A  A)x{k)  +  Bu{k)  +  A»,iWoo(fc)  +  Rafa{k),  (75) 

y(k )  =  (C  +  A C)x(k)  +  Du(k )  4-  D^^ooik)  +  Rsfs(k )  (76) 

where  the  sampling  period  T$  =  0.01  sec.  Only  sensor  faults  are  considered  in  this  example, 
thus  Ra  =  0.  The  elements  of  the  state  vector  x  6  7T.3,  are 

x\  =  High  Pressure  Spool  Speed  (rpm) 

X2  —  Low  Pressure  Spool  Speed  (rpm) 

£3  A  High  Pressure  Compressor  Inlet  Temperature  (°C). 


Curry  and  Collins 


14  of  34 


The  elements  of  the  control  input  vector  u  eH3,  are 


u\  =  Main  Burner  Fuel  Flow  (kg/hr) 

U2  =  Exhaust  Nozzle  Throat  Area  (m2) 

113  =  Bypass  Duct  Area  (m2). 

The  elements  of  the  output  vector  y  ETl3,  are 

yi  =  Corrected  High  Pressure  Spool  Speed  (rpm) 
y2  A  Corrected  Low  Pressure  Spool  Speed  (rpm) 
y3  =  Corrected  High  Pressure  Compressor  Inlet  Temperature  (°C). 


The  variable  w  denotes  a  vector  of  disturbance  signals. 

The  uncertainty  matrices,  A  A  and  AC,  are  representative  of  some  engine  degradation 
over  time.  Thus,  it  is  assumed  that  a  newly  constructed  engine  can  be  modeled  with  the  nom¬ 
inal  matrices  A  and  C  and  with  use,  the  parameters  of  the  degraded  engine  are  encompassed 
in  the  uncertainty.  The  system  parameter  matrices  are 


0.9835  0.0110  0.0039  ' 

A  =  3.788e  -  4  0.9858  0.0026  ,  Ao,  1  =  diag{0.1,  0.1,  0.01},  (77) 

4.230e  -  6  -2.282e  -  4  0.9891 

0.0080  0.2397  -0.0383  1  [  1  0  0  ' 

B=  0.0068  0.1565  0.0248  ,  Rs  =  0  10  ,  (78) 

2.691e  -  4  — 2.912e  -  4  2.558e  -  4  J  [  0  0  1 

0.2383  0.4871  0.1390 

C=  — 1.074e  —  5  — 8.399e  —  4  3.784e  -  4  ,  (79) 

2.070e  -  5  — 4.132e  -  5  -4.335e  -  6 


0.4171  -4.492  0.4875 

D  =  7.968e  -  4  -0.0050  2.861e  -  4  ,  A*,, 2  =  0.1  x  /3x3.  (80) 

— 1.270e  -  5  4.837e  -  4  -0.0021 
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The  uncertainty  matrices  AA  —  —HaFaGa  and  AC  =  —HqFcGc,  where 


■  1  0  0  ' 

'ill' 

Ha  =  ~ 

0  1  0 

,  Hc  =  - 

0  0  0 

0  0  1 

0  0  0  _ 

Ga  = 


Gc  = 


Fa  =  diag{ Jyi! ,  SAa,  ^3}»  Fc  =  diagjfc,,  6C2,  5C3), 


(81) 


with 


-0.02167  <  5a,  <  0.02167,  -0.02174  <  6Ai  <  0.02174, 
-0.02181  <  5As  <  0.02181, 

-0.01787  <  5C,  <  0.01787,  -0.03653  <  5C2  <  0.03653, 
—0.01043  <  5c3  <  0.01043. 


(82) 

(83) 


Note  that  the  uncertain  parameters  5a,--- 5a3  correspond  to  parameter  fluctuations  in 
the  diagonal  elements  of  matrix  A  and  6c,  ■  ■■  5c3  correspond  to  the  first  row  of  C.  In  the  real- 
coded  genetic  algorithm,  the  chromosome  string  0  (72)  consisted  of  39  genes,  corresponding 
to  the  elements  of  Ae  €  7£3,  W  €  7Z3,  P  €  TZ3  and  the  diagonal  elements  of  H,  N  6  V6. 
By  using  the  objective  function  (57)  with  stability  constraints  (74),  the  respective  gain  and 
projection  matrices  are  obtained  for  a  bank  of  estimators.  The  nominal  (uncertainty  not 
considered)  gain  matrices  were 


-4.3677 

0.9652 

2.1343 

0.0324 

-0.1080 

1.7946 

Wn,l  = 

-46.331 

-0.4433 

2.5012 

)  Fn,l  ~ 

-0.0042 

0.0218 

-0.0179 

185.10 

0.0755 

-12.637  _ 

0.0242 

-0.0931 

1.3789 

8.5628 

2.1809 

-0.9584  ' 

* 

-0.0072 

0.3017 

0.2845 

II 

<N 

-12.065 

4.3910 

1.2877 

II 

<N 

af 

0.0009 

-0.0376 

-0.1761 

34.830 

0.6572 

-3.4886  _ 

0.0092 

-0.3725 

-1.8386  _ 

11.665 

2.2105 

-11.263 

1 

'  -0.0041 

0.3916 

-0.9689 

Wn,3  = 

-6.0256 

-1.1449 

-17.177 

II 

eo 

of 

0.0005 

-0.0207 

-0.2238 

5.0019 

0.9603 

-17.767 

-0.0025 

0.3185 

-1.8625 

(84) 


(85) 


(86) 


Note  for  all  nominal  filters  the  system  matrix  Ae  =  A.  The  robust  (uncertainty  explicitly 
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As  shown  above,  for  both  the  nominal  and  robust  systems  three  filters  were  designed 
corresponding  to  targeted  faults  f\,  /2  and  / 3.  To  verify  the  solutions  obtained  by  the 
RCGA,  the  frequency  response  of  the  closed-loop  systems  were  examined.  Specifically,  Bode 
diagrams  were  used  to  check  the  magnitude  of  the  transfer  functions  from  the  faults  fi,  /2, 
and  f$,  and  the  disturbances  w\,  u>2  and  wz  to  the  residual  signals  rq,  r2  and  r$.  Figure 
4  shows  the  response  of  filter  3  of  the  nominal  system,  where  the  target  fault  is  fz  and 
the  residual  signal  is  rz ■  It  can  be  seen  that  the  influence  of  the  target  fault  signal  on  the 
residual  is  significantly  larger  than  the  influence  of  the  nuisance  faults  and  disturbances  over 
all  frequencies.  Similarly,  in  Figure  5  filter  2  of  the  robust  system,  where  the  target  fault 
is  f'2  and  the  residual  signal  is  r2,  the  influence  of  the  target  fault  signal  on  the  residual  is 
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larger  than  the  nuisance  faults  and  disturbance  signals.2 

In  order  to  illustrate  the  application  of  the  robust  t\  estimator  to  robust  fault  detection, 
FDI  of  the  system  in  (75)  and  (76)  subject  to  plant  disturbances  was  performed.  A  bank 
of  estimators  (as  described  in  Section  3)  was  designed  for  the  set  of  yt-,  i  6  {1,2,3},  sensor 
outputs,  i.e.,  the  ith  estimator  is  designed  to  detect  a  fault  in  the  y,  sensor  while  neglecting 
faults  in  the  remaining  sensors.  Here  the  nominal  case  as  well  as  the  robust  case  are  consid¬ 
ered  for  the  FDI  process.  Random  white  noise  signals  with  zero  mean  were  added  as  both 
the  disturbance  inputs  and  sensor  noise.  The  variances  of  the  disturbance  inputs,  w\,  w2 
and  W3,  were  0.05,  0.08  and  0.03,  respectively.  In  order  to  show  the  extent  of  robustness, 
uncertainty  for  all  system  matrices  was  considered.  The  uncertain  parameters  are  assigned 
random  values  within  their  respective  ranges.  The  values  are  given  in  Table  1. 

This  example  only  considered  the  occurrence  of  sensor  faults  within  the  system.  A  typical 
sensor  fault  in  the  jet  engine  is  a  drift  in  the  sensor  reading.  Thus,  a  slow  drifting  (or  ramping) 
sensor  fault  was  added  to  a  sensor  reading  at  a  particular  instant  in  time.  Specifically,  the 
simulated  fault  signal  can  be  described  by  the  linear  function 

0,  k  <  kf 

r(k  —  kf),  k  >  kf 

where  r  =  0.1  is  the  slope  and  kf  is  the  instant  at  which  the  fault  occurs.  Due  to  the  distur¬ 
bance  the  finite-horizon  infinity  norm  (64)  of  the  residual  with  N  —  N0  =  60  (corresponding 
to  a  time  interval  of  0.6  sec.),  was  nonzero  even  in  the  absence  of  faults. 

In  Figures  6  through  8  a  single  sensor  fault  was  introduced  in  the  system.  Specifically,  in 
Figure  6  a  fault  was  introduced  in  sensor  yi  at  t  =  20  sec,  Figure  7  has  a  fault  introduced  in 
sensor  y2  at  t  =  30  sec,  while  a  fault  in  sensor  y3  is  introduced  at  t  —  40  sec  in  Figure  8.  It 
can  be  seen  that  both  the  nominal  and  robust  estimators  were  able  to  successfully  detect  and 
isolate  each  fault.  This  is  evident  as  each  faulty  sensor  the  residual  surpassed  its  respective 
threshold  at  the  the  time  of  occurrence  of  each  fault.  However,  it  is  noted  that  in  each 
nominal  estimator  system  false  alarms  are  given  in  one  of  the  fault  free  sensors.  This  is  due 
to  the  fact  that  uncertainty  was  not  accounted  for  in  the  design  of  these  estimators.  These 
false  alarms  are  avoided  with  the  robust  filters.  In  Figure  9  multiple  faults  were  introduced 
in  sensors  y\ ,  y2  and  y3  at  t  =  25  sec,  t  =  10  sec  and  t  =  40  sec,  respectively.  It  can  be 
observed  that  in  this  instant  both  nominal  and  robust  systems  were  able  to  isolate  each 
target  fault  from  the  other  nuisance  faults.  A  false  alarm  is  again  given  as  the  first  residual 
surpasses  its  threshold  well  before  a  fault  is  introduced  in  the  sensor.  This  does  not  occur 

2These  trends  are  representative  of  the  behavior  of  each  filter  response. 
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with  the  robust  estimator. 


Conclusions 

This  paper  considered  the  application  of  robust  l\  estimation  for  uncertain,  linear  discrete¬ 
time  systems  to  the  robust  fault  detection  and  isolation.  Mixed  structured  singular  value 
theory  of 18  was  used  to  design  a  bank  of  robust  t\  estimators  and  the  resulting  fixed  threshold 
logic.  By  considering  a  discrete,  linear  model  of  a  jet  engine  with  real  parametric  uncertain¬ 
ties  and  introducing  drifting  sensor  faults,  it  was  shown  that  the  robust  FDI  methodology 
based  on  fixed  thresholds  was  capable  of  detecting  and  isolating  failures  in  each  of  the  par¬ 
ticular  sensors.  Also,  by  designing  the  robust  estimators  to  explicitly  account  for  uncertainty 
false  alarm  rates  were  significantly  reduced. 
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